MULTI LOOP MANUAL CONTROL OF DYNAMIC SYSTEMS 


Ronald A. Hess and B. David McNally 
Department of Mechanical Engineering 
University of California 
Davis, California 95616 


ABSTRACT 

Modern, high performance aircraft increasingly rely upon high-authority 
stability and command augmentation systems to achieve satisfactory performance 
and handling qualities. In addition, certain tasks which have traditionally 
been allocated to the human pilot are candidates for automation in the near 
future. This situation has accentuated a long-standing need for a thorough 
understanding of the human's capabilities, limitations and preferences when 
interacting with complex dynamic systems, particularly when the question of 
task allocation between man and machine arises. In this work, an analytical 
and experimental study was undertaken to investigate human interaction with 
a simple, multiloop dynamic system in which the human's activity was system- 
atically varied by changing the levels of automation. The control loop struc- 
ture resulting from the task definition parallels that for any multiloop manual 
control system, and hence, can be considered as a stereotype. The analytical 
work concentrated upon developing simple models of the human in the task, 
and upon extending a technique for describing the manner in which the human 
subjectively quantifies his opinion of task difficulty. The experimental 
work consisted of a man-in-the-loop simulation providing data to support and 
direct the analytical effort. 

INTRODUCTION 

Automation has become a central issue in the design of man-machine systems 
in the past decade, particularly as regards manned aircraft. The pilots role 
as a systems manager or supervisor is being emphasized as the capabilities 
of modern avionics systems, in particular, digital computers, evolve. Indeed 
man-machine interaction has become nearly synonomous with man - comput er ^ 
interaction in describing the activity of the pilot in the cockpit of the 
future. 

It is worth emphasizing that the fundamental role of the human in the 
aircraft cockpit is still that of a "controller" in that nearly all his 
activity has, as its ultimate aiip, the control of the vehicle's velocity 
vector. 

A convenient means of explaining the nature of tasks involving the manual 
or automatic control of dynamic systems such as aircraft is shown in Fig. 1. 
Hbre, ft,- represents a generalized "bandwidth" indicating the relative time 
scales involved in each of the loop shown. The nesting of feedback loops with 
> ft ? > fto . . . > Q is a characteristic of nearly all dynamic control 
systems, no matter how Bomplex. As an example of an aircraft flight control 
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problem, the loops of Fig. 1 could be interpreted as f ^lows: The block denoted 

n. represents attitude control with a relatively high bandwidth. Block 
represents altitude control with a lower bandwidth while block ^ represents 
navigation activity with a still lower bandwidth. 

The ways in which a man and a computer can interact in the system of Fig. 

1 can be quite subtle and have been outlined, classified and discussed by 
Rouse m . They are obviously dependent upon which function are under manual 
and which’ are under computer (automatic) control. Figure i invites a simple 
and practical allocation of tasks between man and computer (manual a °d automatic 
control) One can start at the inner-most loop and begin automating the feed- 
S activity loop-by-loop. This means that the human is responsible for fewer 
loop closures as the automation proceeds and these with lower and lower 
bandwidths. Conversely, one can start at the outer-most loop and begin the 
automation process. Again, as the automation proceeds, the human is responsible 
for fewer loop closures, but the bandwidth of the manual control task is, in 
this case, dominated by the inner-most loop. Both of these schemes are consis- 
tent with current practice in aircraft flight control automation. For example, 
the first is exemplified by an automatic landing system while the second is 
exemplified by the same landing task, except using a cockpit flight director. 
Both schemes can result in increased man-machine performance and decreased 
"workload". i 

It is of some interest to analyze these two automation approaches, partic- 
ularly when outer-loop preview information is available to the human. To this 
end, an analytical and experimental study was undertaken to investigate human 
interaction with a simple, multiloop dynamic system in which the human s 
activity was systematically varied by changing the level of control ^P^fi* 
(automation level). The control loop structure resulting from the task d ^ 1_ 
nition is consistent with that of Fig. 1 and, as such, can be considered as 
a simple steroetype. . The analytical work concentrated upon developing simple 
models of the human in the task, including preview effects, and 
a technique for describing the manner in which the human subjectively quanti- 
fies his opinion of task difficulty [2] . The experimental work consisted of 
a man-in-the-loop simulation providing data to support and direct the analytical 

effort. 

EXPERIMENT 

A simple man-in-the-loop simulation was conducted on a fixed-base labora- 
torv type simulator at NASA Ames Research Center. The actual task considered 
was^that of the longitudinal control of a hovering helicopter or VTOL vehicle. 
The multiloop system is shown in Fig. 2. This figure indicates completely 
manual operation in its present form and the basic vehicle r ?p S a?H?M d i deter- 
rate-command, attitude-hold pitch attitude dynamics. 

mines vehicle velocity, which, in turn, determines vehicle displacement from 
some command position. Figure 2ialso outlines the automation levels which 
werl examined in this study. If the inner-most loop of Fig. 2 is automated 
the human is left with an attitude-command, attitude-hold "inner loop, with 
velocity and position loops unchanged. If the next inner-loop of Fig. 2 is 
also automated, the human is left with a velocity-command position-hold 
system Finally, by automating all the loops of Fig 2 but leaving the pilot 
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the option of providing a position-command signal to the automated system, a 
position-command, position-hold system results. Conversely, of the outer-most 
loops are closed and an inner-loop command signal displayed to the pilot, a 
flight director system results (not indicated in Fig. 2). 

The unagumented vehicle dynamics were very simple and can be given as: 

x = u 

u = -ge + X u u 
§ = K<5 


where x represents vehicle position, u vehicle velocity, 0 vehicle attitude 
and 6 control deflection. 

A color, raster-type display was used in the experiment to provide 
the subjects with the pertinent information needed to close the loops in Fig. 
2; The display format is shown in Fig. 3. An isometric manipulator was used 
in all but the position command configuration where an unrestrained finger 
manipulator was employed. Each of the automated closures were implemented in 
a manner similar to that which would be employed by the human were he asked 
to close the loops in question. 

The human pilot dynamics were estimated by using the simplifed crossover 
model of the human [3] for each loop closure: 

V Y c = <“c. /s > e " TeS (1) 

1 1 


where Y D - represents the human pilot dynamics in the closure in question, Y c . 
represents the pertinent vehicle dynamics in that closure, and oj C j represents 
the open-loop crossover frequency (or closed-loop bandwidth). For example, 
the attitude-command system was implemented by allowing Y pQ in Fig. 2 to 
take the form 


where w is the appropriate crossover frequency and K is the gain appearing 
in 0/6. c 0 Of course, the human's effective time delay was deleted in 
implementing the automated loop closures. 

' The command signal x was chosen as a square wave with a fundamental 
frequency of 0.2 rad/sec. This command signal was displayed to the subject 
in preview fashion as the horizontal translation of the square waveform on 
the display of Fig. 3. The amplitude of the command signal was 50 ft. The 
loop crossover frequencies were chosen by equating the position-loop crossover 
frequency, w c , to that of the fundamental component of the command signal 
and then separating the remaining crossover frequencies by a factor of t:hre e . 
This factor was suggested by other multiloop manual control experiments L4J. 
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The position command signal was chosen as periodic to encourage higher levels 
of skill development on the part of the subjects. 

Four naive subjects participated in the experiment. Each simulation run 
lasted approximately 95 seconds. Each subject saw the 5 different configura- 
tions presented in the following order: (1) velocity command, (2) rate command, 

(3) flight director, (4) attitude command, and (5) position command. Root- 
mean-square (RMS) performance scores were recorded as were pilot opinion 
ratings of task difficulty quantified on a non-adjectival rating scale [5J. 

The subjects were instructed to minimize position errors while maintaining 
realistic vehicle pitch rate. The quantify the latter, an audio alarm 
sounded whenever 6 exceeded 10 deg/sec; Data was taken only after RMS per-f 
formance scores stabilized. 

RESULTS 

Figure 4 summarizes the outer-loop position performance for the subject 
with the best performance (subject 3) for each configuration. The unfilled 
symbols in Fig. 5 show the subjective task difficulty ratings for each 
configuration averaged across all the subjects. A technique for obtaining 
objective measures of task difficulty from analysis of control movements was 
investigated [6]. Specifically, the number of individual "control movements" 
during any run were measured and recorded. As implemented in this study, a 
"control movement'' 1 was said to occur when the subject's control input exceeded 
a criterion value defined as a percentage of the RMS value of the output for 
that run. A criterion value of 75% was found to produce trends in the control 
movement data which compared well with those of the subjective opinion data 
with the exception of the flight director. This discrepancy will be discussed 
in the next section. The control movement results are shown in Fig. 6 for 
each configuration, averaged across all subjects. 

Figure 7 shows typical /time responses in x, u, and 9 for subject 3 for 
each of the automation configurations. This figure also demonstrates one 
of the most important results of the! experimental study. Namely, with the 
exception of the flight director, all configurations allowed the subjects 
to synchronize the vehicle position x(t) with the command input x c (t). 

Since the flight director was the only configuration which forced compensato- 
ry behavior on the part of the subjects, the remaining configurations apparent- 
ly allowed higher levels of skill development associated with preview tracking. 

PILOT MODELING 

A simple pilot modeling effort was undertaken to identify, at least 
approximately, the pertinent model parameters in the completely manual 
system of Fig. 2. An off-line computer simulation of that system was imple- 
mented. Nominal pilot models of the following form were examined: 

Y = w r e~ T e s = 1.8e" 0,3s 
Pe c e 

Y p = w c =0 - 6 (2) 

^u u 
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! = to = 0.2 

p x c x 


It was found that no choice of the parameters in Eq. (2) would yield model 
time responses that provided adequate matches to the data, even when the comma n 
input x c was advanced in time to model preview. However, when the acbual 
square wave time history for x c was replaced with Jhe Position command which 
the subject generated in using the position command system, a 
improvement was seen in the modeling results. Fig. 8 comapres the sub J®^7. 
generated position command for subject 3 with tha actual square wave Posit 
command. It should be noted that all the subjects generated commands which 
were similar in nature to that of Fig. 8 when using the most automated, 
position command system. An accurate approximation to the ^ ub ■j e ^"9 e ' 1 ^^ ec, 
position command was implemented in the off-line computer simulation using 
the pilot model of Eqn, 2) with the nominal parameter values shown. The 
resulting time histoHes afe shown in Fig. 9. They are seen to compare 
quite favorably with the experimental traces shown in Fig. /a. 

Finally an analytical means for determing task difficulty using a struc- 
tural model of the human pilot [7J was investigated. The approach was intro- 
duced in Ref 2, but dealt soley with single-loop tracking tasks in that study. 
Figure 1 10 shows a simplified version of the structural mode of he human 
Dilot [21 . Following the lead of Smith [ 8H , it was shown in Ref . 2 that 
the RMS value of the signal u m in the model of Fig. 10 correlated quite well 
with pilot opinion ratings of vehicle handling qualities when mode} I parameter 
were selected which produced human operator transfer functions which matche^l 
?ho^e measured in experiment. It was hypothesized here that the method of 1 
Ref. 2 could be extended to multiloop tasks by considering tb e activUy on^ 
in the inner-most loop of any multiloop task. For example, consider Yp„ for 
the comBTifilymihual configuration of Fig. 2. One can see from ; Fig 16 that 
the RMS^value of u m is determined by the characteristics of 
command 9 C once th@ structural model parameters have bea " s ® 1e ^ d ?c 
vide a realistic Y n n. Now the simplified structural model of Fig. 10 is 
parameterized by K^and K^. However, for K/s controlled element dynamics. 

Fig. 10 indicates 


u m = < sK n/< s/ “c + 1))9 c 


Thus, the effect of manual outer-lOop closures in determining u ffl is contained 
in the characteristics of 9 C - 

Thus usinq the nominal bandwidths of Eqn. (2), the RMS value of u m 
can bJ determined in terms of the model parameter for each automation 

l oupi iicina the off-line computer simulation. The fact that the inner mos 
manual closure for any automation level always (except the position comman ) 
involves K/s dynamics and the control sensitivities have been optimized for 
each closure, leads to the final assumption that, in terms of the model, 
can be considered invariant across all configurations. 

The filled symbols shows the RMS u m values obtained from the off-line 
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simulation for each automation level, except the position cormiand, in 
which K/s open- 
RMS valbes of u 
place of the ac 

the effects of noisy observations, broadband noise with an RMS value of 10 ft 
was injected in parallel with the position command. The noise was removed 
in modeling the human using the flight director since the single, compensatory 
closure would involve minimal observation noise as compared to the other closures. 

i 

DISCUSSION 


loop dynamics were not in evidence. In generating the 
(a ), the subject-generated position command was used in 
tualcask position command as discussed previously. To model 


Control strategy and automation level 

The control strategy adopted by the subjects for each automation level 
can best be interpreted in terms of the resulting vehicle velocity time 
histories in Fig. 7. As the figure indicates, in configurations where preview 
information was available (all but the flight director) the velocity responses 
appear as a series of relatively uniform alternating pulses. With the outer 
position loop open in Fig. 2, the effective open-loop dynamics are approxi- 
mately 1/s in the frequency region around w c . McRuer, et al , [9j have shown 
that a constrained time-optimal step-response control input to a K/s system 
under manual control is a rectangular pulse. The duration of the pulse was 
shown in 11 to be a physical constraint in manual control problems. In the 
simple single-loop experiments of [97) , the pulse duration was related to 
the duration of a "force program", i.ie., the minimum time possible for the 
human neuromuscular system to generate an accurate pulsive control motion 
with an ideal manipulator. This concept can be adopted here and the duration 
of the velocity pulse is seen to be approximately 3 to 4 times the reciprocal 
of the pertinent loop crossover frequency, Wp u . 

It must be emphasized again that the time histories evident in Figs. 

7a - 7d cannot be adequately explained via Fig. 2 using the step position 
command x c , only Fig. 7e, the flight director, can. This means that the 
available preview information has led to the generation of time optimal 
behavior on the part of the human, regardless of the automation level . As 
Fig. 4 indicates, position performance was also nearly independent of automa- 
tion level when preview information was available. 

Control movement analysis 


The failure of the control movement analysis in following the subjective 
rating trends for the flight director can be traced to the fact that, in using 
the director, all the subjects adopted a very aggressive control strategy. 
This was attributed to the fact that the subjects were aware of the rather 
sluggish response of the flight director configuration relative to the 
other configurations where preview was available. The subjects tried to 
null director errors almost instantly by using pulsive control inputs. 

Although this strategy did not seem to detract from their subjective esti- 
mates of control difficulty, it: certainly would effect the control movement 
analysis and can explain the flight director results of Fig. 6 as compared to 
Fig. 5. 
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Analytical task difficulty measure 


The extension of the single-loop theory for interpreting the manner in 
which the human quantifies his subjective opinion of task difficulty to 
multiloop tasks appears feasible. The extension implies that task difficulty 
is determined by the activity in the inner-most loop being closed by the human 
regardless of automation level. Outer-loop effects, of course, influence 
the subjective estimates through the characteristics of the command signal to 
the inner-most loop. 
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1 =--human control input for rate-command system 

2 = " " " " attitude-command system 

3 = " " " " velocity-command system 

4 = " " " 11 position -command system 

Figure 2. The stereotype multiloop system - hypothesized pilot loop closures 
for a longitudinal VTOL hover task 
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u = vehicle velocity 

6 = pitch attitude 

d fc) = flight director command 

x = actual task position, command 
c 

x' c = subject-generated position command 
x g = position error 

Figure 3. Display format for longitudinal hover experiment 
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automation level 

Figure 4. RMS position performance for one subject for various 
automation levels. Average of 5 runs. 
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Figure 5. Comparison of subjective task-difficulty ratings with model -based metric 
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Figure 6. Control movements analysis 
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Figure 8. Comparison of actual position command with subject-generated command 
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